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ABSTRACT 

The  Daper  provides  a  survey  of  results  in  statistical  inference 
in  systems  reliability  using  Bernoulli  sampling  of  indiviuual  components. 
Particular  attention  is  give*'  to  the  notion  of  Buehler  optimality  and 
its  implementation  in  such  problems.  Recent  results  of  the  authors 
on  Buehler  optimal  confidence  bounds  on  the  reliability  of  series  and 
parallel  systems  are  discussed.  For  series  systems,  these  results 
employ  a  generalization  of  an  inequality  of  Sudakov.  For  parallel 
systems,  Buehler  optimal  bounds  are  obtained  for  small  numbers  of 
failures  using  the  notion  of  Schur  concavity.  Estimates  of  the  optimal 
bounds  are  obtained  in  those  case?  for  which  the  property  of  Schur 
concavity  does  not  hold. 
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SIGNIFICANCE  AND  EXPLANATION 


Parallel  ana  series  systems  arise  naturally  in  practice  in  engineering 
and  physics.  Therefore  it  is  of  substantial  significance  to  be  able  to 
utilize  efficiently  data  obtained  on  individual  components  for  the  purpose 
of  obtaining  an  overall  assessment  of  the  reliability  0/  the  system.  The 
methods  of  this  paper  may  be  employed  for  this  purpose. 
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RECENT  ADVANCES  IN  STATISTICAL  METHODS  FOR  SYSTEM 
RELIABILITY  USING  BERNOULLI  SAMPLING  OF  COMPONENTS 

by 

Bernard  Harris*  and  Andrew  P.  Soms** 


1.  INTRODUCTION 

In  this  paper  we  examine  the  history  of  statistical  inference  in  systems 
reliability  using  Bernoulli  sampling  of  components  with  particular  emphasis  on 
the  notion  of  Buehler  optimality  and  its  role  in  such  problems.  In  particular, 
we  focus  on  recent  results  of  the  authors  which  facilitate  obtaining  Buehler  optimal 
bounds  on  the  reliability  of  series  and  parallel  systems.  For  series  systems, 
these  results  employ  a  generalization  of  an  inequality  of  Sudakov  and  for 
parallel  systems,  Buehler  optimal  bounds  are  obtained  using  the  notion  of  Schur 
concavity  when  the  number  of  failures  is  small.  Estimates  of  the  optimal  bounds 
for  parallel  systems  are  obtained  for  those  cases  in  which  the  technique  employing 
Schur  concavity  fails. 

We  suppose  that  the  system  has  k  components  and  let  p^ ,  1  a  l,2,...,k 

t  h 

be  the  probability  that  the  i  component  does  not  fall.  We  further  assume  that 
the  components  are  stochastically  independent.  Let  h(p^ ,p2,. . . ,Pk)  be  the 
probability  that  the  system  does  not  fail.  Then  the  problem  under  discussion 
may  be  described  as  follows.  The  experimenter  takes  N^  observations  on  each 
of  the  k  components  and  records  y. ,  the  number  of  failures  observed  on  the 
1th  component,  “hen  given  this  datn,  we  wish  to  obtain  a  1  -  a  lower  confidence 
limit  on  h(p-j,P25«»*  fP^) < 
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Throughout  the  discussion,  we  restrict  our  attention  to  coherent 
systems.  These  may  be  described  as  systems  in  which  the  system  fails  when 
all  components  fail  and  the  system  functions  when  all  components  function. 

In  addition,  replacing  a  defective  component  by  a  good  component  will  not 
cause  a  functioning  system  to  fail.  The  reader  is  referred  to  R.  E.  Barlow 
and  F.  Proschan  [1]  for  relevant  details  concerning  the  reliability  function 
h(p-|,...,pk)  and  properties  of  coherent  systems. 

The  problem  discussed  herein  arises  naturally  in  many  situations 
relevant  to  acquisition  decisions.  For  such  an  illustration  consider  a 
"one-shot  device",  namely,  one  which  is  to  perform  a  specific  function  at  a 
specific  time,  so  that  the  lifetime  of  the  device  is  not  a  consideration.  Then, 
you  are  interested  in  assuring  that  the  probability  that  the  device  will  function 
properly  when  it  is  to  be  used  is  at  least  a  specified  number. 

For  a  second  application,  consider  a  system  which  is  to  function  for  a 
specified  length  of  time,  known  as  the  mission  time.  If  the  only  data  avail¬ 
able  is  the  number  of  failures  of  each  component  before  the  mission  time,  then 
the  model  of  this  paper  is  appropriate. 

Throughout  the  paper,  we  emphasize  the  specific  cases  of  series  and 


parallel  systems. 
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2.  BUEHLER  OPTIMAL  CONFIDENCE  LIMITS  FOR  SYSTEM  RELIABILITY 

We  now  introduce  the  notion  of  Buehler  optimality  with  respect  to  the 
ordering  function  g(x),  where  x  =  (x^x^...^),  xi  =  -  >\,  i  =  1,2,. ..,k. 

In  Buehler  (1957),  the  following  principle  was  proposed  and  applied  to  obtaining 
confidence  limits  for  the  product  of  two  binomial  parameters.  This  corresponds 
to  proposing  an  optimal  solution  to  the  problem  of  determining  lower  confidence 
limits  for  the  reliability  of  series  systems  of  two  components. 

g (x)  is  an  ordering  function  if  for  =  (x^.x^,...^^)  and 

~(2) 

x  ~  ^x^l  ,x22  *  * '  *  ^  Xi  i  ^  x  2  i ,  i  —  l,2,...,k,  we  have 

g(x^)  <  g(x^).  In  the  original  formulation,  one  orders  the  II  (N.+l) 

i=l  1 

sample  outcomes  and  lists  the  corresponding  values  of  g(x'.  Then  calculate 

P^g(x)su).  (1) 

This  is  the  probability,  for  fixed  p,  of  getting  an  outcore  as  good  as  or 
better  than  u  since  g(x)  is  ordered  consistently  with  the  lumber  of 
functioning  components  observed  in  the  sample. 

If  we  let 


Qa(u)  =  (p:  P~(g(x)  >  u)}  >  a  .  (2) 

Then  Qa  is  a  1-a  confidence  region  for  p  determinea  byg(x).  This 
can  be  extended  to  a  1-a  lower  confidence  bound  for  h (p)  by  letting 

h(u)  =  inf  (h(p) :  P~(g(x)  >  u)  >  al  ,  (3) 

for  0  <  a  <  1.  It  can  be  shown  that  if  _£(u)  is  any  other  system  of  lower 
confidence  limits  based  on  the  ordering  function  g(x),  then  i(u)  <  h(u) 
for  all  u.  Further  details  on  this  optimality  property  and  a  proof  of 
the  above  assertion  may  be  found  in  Harris  and  Soms  [8]. 
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Unfortunately,  while  this  does  give  a  procedure  for  obtaining  best 
lower  confidence  bounds  once  g(x)  has  been  specified,  this  does  not  say  how 
to  choose  g(x).  For  various  kinds  of  systems,  many  researchers,  have  proposed 
different  ordering  functions  and  quite  a  few  statisticians  have  suggested 
procedures  which  have  the  Buehler  optimality  property  asymptotically  but 
not  necessarily  for  any  fixed  sample  size.  In  addition  the  literature 
contains  many  suggested  procedures  which  are  not  optimal  but  possess  some  other 
favorable  attribute  such  as  ease  of  computation,  while  not  deviating  too  far 
from  optimality.  As  originally  described  by  Buehler  many  procedures  employing 
Buehler  optimality  are  virtually  incomputable  for  k  >  2. 

Other  properties  which  some  writers  have  considered  desirable  are 
exactness  and  conservatism.  Specifically,  a  confidence  interval  procedure  is 
exact  if  there  are  parameter  points  such  that  for  those  points,  >  a  in  (3) 
can  be  replaced  by  equality.  In  the  case  of  (3),  this  is  true  for  a  large 
class  of  ordering  functions,  since  h(p)  is  continuous  and  the  infimum 
will  be  attained.  A  confidence  interval  procedure  is  conservative  if  the  true 
confidence  coefficient  is  at  least  1-a  for  all  parameter  points.  Clearly, 
many  asymptotic  approximations  and  other  approximate  procedures  will  violate  this 

We  discuss  this  by  looking  at  some  specific  types  of  systems,  beginning 


with  senes  systems. 
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3.  LOWER  CONFIDENCE  LIMITS  FOR  THE  RELIABILITY  OF  SERIES  SYSTEMS 


A  natural  first  attempt  in  selecting  an  ordering  function  for 

k 

series  systems  is  to  choose  a  point  estimator  for  h ( p )  =  n  p. .  Such  an 

1-1  7 

estimator  is  the  maximum  likelihood  estimator  given  by 

k  X. 

h(p)  -  n  =i  .  (4) 

1=1  "i 

In  the  situation  where  the  p.'s  are  close  to  unity,  the  high  reliability 
case,  we  can  write 


k  N.-Y. 

hip)  -  n  4-1  (S) 

1=1  1 

and  if  the  's  are  large,  this  is  commonly  approximated  by 

k  Y.  k  Y, 

h(p)  =  n  (1  -  rr->  ~  1  “  I  m—  (6) 

i=l  i=l  Ni 

Then,  under  the  assumption  that  the  p^'s  are  close  to  unity,  if  the  N^'s 
are  all  "large",  this  suggests  replacing  the  original  assumption  of  the 
binomial  distribution  by  the  Poisson  distribution  and  this  alternative  has 
been  exploited  by  many  practitioners.  In  particular,  l-h(p)  is 
regarded  as  having  a  Poisson  distribution  with  parameter  E>  ./N^. 

Some  alternative  ordering  functions  that  have  been  considered  are 


Vi +  V1/2- 


(7) 


where  z  satisfies  1  -4>{z  )  =  a,  $(x)  is  the  standard  normal  distribution 

a  a 

function,  a-j  >  •••  >  an  and  a^  =  I  ^7  This  choice  was  proposed 
by  M.  V.  Johns,  Jr.  [10]  and  is  somevnat  suggestive  of  (6)  in  that  it  is 
a  weighted  normal  deviate  suggested  by  the  Poisson  approximation  noted 
previously. 


confidence 


Buehler  [2]  ordered  by  computing  separate  1  -(l-a)^ 
bounds.  The  product  of  the  separate  confidence  limits  is  the  final 
lower  confidence  limit. 

It  should  be  noted  that  Buehler  directed  most  of  his  discussion  to 
parallel  systems  and  all  of  his  approximations  and  numerical  examples  are 
appropriate  only  for  that  application.  However,  using  the  duality  noted  later, 
the  general  discussion  in  his  paper  can  be  applied  equally  well  to  both 
series  and  parallel  systems. 

Closely  related  to  the  maximum  likelihood  estimator  and  sometimes 
employed  as  an  ordering  function  are  estimators  of  the  form 

k 

•  g(x)  =  n  (X.-a.)/(N.-$.)  ,  (8) 

i=l  11  11 

where  a.,  &.  may  be  dependent  on  the  X^. ' s  and  N -  *s .  Naturally,  a., 
and  B..  must  satisfy  conditions  such  that  g(x)  will  be  asymptotically 
equivalent  to  the  maximum  likelihood  estimator  (5). 

An  example  of  this  approach  is  given  by  A.Madansky  [13],  who  calculated  the 
Wilks'  likelihood  ratio  L(x)  and  used  the  asymptotic  result  that  -2  log  L(x) 
has  asymptotically  a  chi-square  distribution  with  one  degree  of  freedom  to 
obtain  a  lower  confidence  limit  to  the  reliability  function  h(p).  He 
compared  the  results  obtained  using  the  likelihood  ratio  to  those  that 
would  be  obtained  employing  the  maximum  likelihood  estimator,  where  the 
distribution  of  the  maximum  likelihood  estimator  is  approximated  by  employing 
asymptotic  normality  and  the  usual  asymptotic  variance  for  the  maximum 
likelihood  estimator.  Madansky  refers  to  this  as  the  linearization  method. 

For  this  case,  the  approximate  lower  confidence  limit  has  the  form 
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X, 


"sf-  ("t*»,/2*«  • 


(9) 


where 


q<X>  •  l  <^>!  P(0  '  P,) 


(10) 


For  both  of  these  techniques,  the  convergence  to  the  asymptotic 
distribution  is  not  uniform  and  substantially  larger  sample  sizes  are  required 
near  the  boundary  of  the  parameter  space  in  order  for  the  limiting  distri¬ 
bution  to  provide  a  satisfactory  approximation. 

Some  technical  improvements  using  the  likelihood  ratio  technique  are 
given  in  C.  Mack  [12],  but  their  relationship  with  the  likelihood  ratio 
procedure  is  not  identified  in  that  paper. 

The  Lindstrom-Madden  method,  as  described  in  Lloyd  and  Lipow  [11]  is 

of  fundamental  importance  to  this  discussion.  Let  h(p)  denote  the  maximum 

likelihood  estimator  as  in  (5)  and  let  N  =  min  N.  .  Then  regard  _N(l-h(p))  =  V 

Ui<k  1 

as  the  number  of  failures  in  N  Bernoulli  trial  and  use  the  usual  method 
of  obtaining  a  lower  confidence  limit  for  a  single  binomial  proportion.  In 
general,  V  will  not  be  an  integer,  so  that  the  interpretation  as  a  binomial 
random  variable  is  not  completely  justified.  One  proceeds  by  interpolation  in 
either  the  tables  of  the  binomial  distribution  or  in  the  tables  of  the  incomplete 
beta  function.  Some  forms  of  non-linear  interpolation  have  also  been 
proposed  and  investigated. 

Although  this  procedure  is  widely  used  by  engineers,  it  is  our  impression 
that  statisticians  tended  to  view  it  with  some  skepticism.  However,  extensive 
simulations  and  numerical  computations  made  prior  to  the  issuance  of  the 
Handbook  for  the  Calculation  of  Lower  Statistical  Confidence  Bounds  on 
System  Reliability  [3]  suggested  that  it  performs  as  well  as  any  of  the  competing 
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methods  under  investigation  in  the  region  of  high  reliability.  In  addition 
the  simulations  strongtly  suggested  that  it  met  the  requirement  of  being 
conservative,  that  is,  that  the  true  confidence  level  is  always  at  least 
as  high  as  the  nominal  confidence  level.  A  proof  of  this  fact  using  as 
inequality  due  to  Sudakov  [21]  is  given  in  Harris  and  Soms  [8].  The 
Undstrom-Madden  technique  has  been  recommended  for  series  systems  in  the  above 
mentioned  handbook. 

Closely  related  to  the  Lindstrom-Madden  method  is  the  method  of  "key 
test  results"  introduced  by  K.  A.  Weaver  [22]  and  extended  by  A.  Winterbottom  [23]. 
The  maximum  likelihood  estimate  h(p)  is  calculated.  Let  N=min  N.. 

~  l  1 

Calculate  [Nh ( p ) ] .  This  of  course  is  always  an  integer.  Then  find  the  usual 
binomial  confidence  limit  for  N  and  [Nh(p)]  =  x.  If  Nh(p)  is  an  integer, 
then  the  Lindstrom-Madden  method  and  the  key  test  method  coincide.  Since  we 
have  shown  [  8  ]  that  the  Lindstrom-Madden  method  is  conservative.  It  follows 
that  the  method  of  key  test  results  is  at  least  as  conservative. 

Easterling's  [4]  modified  maximum  likelihood  method  also  employs  the  maximum 
likelihood  estimator.  From  the  usual  asymptotic  theory  for  maximum  likelihood 


estimation,  the  estimator  h(p)  has  an  asymptotic  variance  given  by 

°Mp)  “j,  (^)  Var(5i>  • 

Replace  by  p^  in  the  above,  thereby  obtaining  (10),  and  set 


OD 


O*  .  =  h(plO-h(p)) 
°Hp)  n 


02) 


Then  regard  n  as  the  binomial  sample  size  with  n  h(p)  successes  observed 
and  obtain  the  lower  confidence  interval  for  a  single  binomial  parameter,  inter¬ 
polating  as  in  the  Lindstrom-Madden  method. 
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A  further  modification  is  suggested  in  which  n  and  x  are  replaced 
by  the  next  integer.  This  is  designated  as  the  MMLI  method.  The  suggestion 
that  this  may  be  satisfactory  is  deduced  from  an  examination  of  the 
deficiencies  noted  in  the  linearization  (maximum  likelihood)  method  by 
Madansky. 

In  a  related  investigation,  J.  L.  Epstein  [5]  considered  the  problem 
of  confidence  sets  for  the  product  of  two  binomial  parameters.  This  can  be 
interpreted  as  either  a  parallel  or  a  series  system  in  the  reliability 
context.  Epstein  was  motivated  by  some  biomedical  applications  in  which 
the  assumption  of  high  reliability  for  each  of  the  components  is  not  as  natural 
as  it  is  for  the  engineering  reliability  context. 

In  studying  this  question,  Epstein  considered  the  two  ordering  functions 

X-.  X2  _  (X1+1)(X2+1) 

91VX)  =  ’  g2(x)  =  * 

He  concluded  that  the  second  was  preferable  to  the  first,  since  the  partition 
of  the  sample  space  induced  by  the  second  is  finer  than  that  induced  by  the 
first.  This  effect  is  particularly  pronounced  when  either  or  is 
zero.  This  is  not, however,  a  significant  factor  for  series  systems  with  high 
reliability.  It  is,  nevertheless,  quite  important  for  parallel  systems  with 
high  reliability,  as  we  shall  subsequently  observe. 

Apparently  ideas  similar  to  those  deduced  by  Epstein  motivated  the 
development  of  the  technique  suggested  by  Sandia  Corporation  and  referred  to 
as  CONLIM  [6]. 

let  h(p)  be  the  reliability  function  of  any  coherent  system.  Then  let 


g(x)  =  h(p)  , 


(13) 


where  p  =  (fy . Pk)  and 

Pj  =  (X.+l)/(N,+2),  1  <  i  <  k  . 


04} 


For  the  series  system,  this  reduces  to 

k 

g(X)  =  n  (X.+l )/ (N.+2) .  (15) 

t=l  1  1 

The  particular  choice  of  p.  leads  one  to  suspect  that  this  was  motivated 
by  Bayesian  considerations  employing  independent  uniform  priors  on  0  s  p.  si. 
The  computer  program  which  uses  (13)  to  calculate  lower  confidence  bounds 
for  system  reliability  is  capable  of  dealing  with  a  large  variety  of  systems, 
but  unfortunately,  a  substantial  amount  of  computer  time  is  often  required 
in  order  to  calculate  the  lower  confidence  limit. 

The  Poisson  approximation  methods,  alluded  to  earlier,  have  principally 
been  exploited  by  statisticians  from  the  Soviet  Union. 

In  particular,  Pa  lov  [19]  used  the  ordering  function  (6),  by  defining 
the  parameter  for  which  the  confidence  limit  is  sought  as 


(16) 


Then,  choose  M  so  that  MN^,*--,MNk  are  all  approximately  integers. 
This  results  in 


Mp  =  M1X1  +  M2X2  +  •••  +  MkXk  (17) 

and  E  M^Y,.  is  a  suitable  statistic  for  estimation  of  the  parametric  function 
(17)  and  therefore  can  be  easily  employed  to  get  confidence  bounds  on  p  . 

As  a  specific  illustration,  consider  k  =  3,  N-j  =  600,  Ng  =  300, 


Ng  ~  100.  Then,  from  (6)  , 


n 


and 


h(p)  ~  1 


gl 


g3 


600(1  -  h(p))  ~  600  (  h  +  X2  +  h) 

\600  300  100/ 

so  that  Y.j  +  2Yg  +  6Y^  is  an  appropriate  statistic  to  use  for  estimation  of 
h(p)  and  for  other  inferential  purposes. 

Another  method  for  employing  Poisson  approximations  has  been  given 
by  Mirniy  and  Soloviev  [18].  This  technique  may  be  described  as  follows. 

Let  k 

k  .1  log  pi 

h(p)  =  n  p.  =  e1"1  .  (18 

i=l  1 


For  p..  near  one,  as  is  appropriate  for  high  reliability. 


log  Pi  —  (1  -  pi)  . 


Let  Xj  =  N.(l-p.),  i  =  1,2,***,k.  Then  construct  an  upper  confidence 
n 

limit  for  l  X.  and  an  approximate  upper  confidence  limit  for 
i=l  1 


(1-P^) 


k 

.  z 

i=l 


Xi/Ni 


09] 


is  given  by  max(-E  X^/N^ ),  where  the  maximum  is  over  the  set 
k 

{  a  X.  s  A),  A  the  upper  confidence  limit  referred  to  above.  This 
i=l  1 

procedure  is  completely  analogous  to  the  procedure  using  (2)  and  (37),  except 
that  an  upper  confidence  bound  is  being  constructed  for  the  unreliability. 

This  brief  survey  makes  no  pretense  of  being  complete.  In  particular, 
the  reader  is  referred  to  the  paper  by  Joan  Rosenblatt  [20],  which  contains 
a  survey  of  many  of  the  early  techniques  employed  for  this  problem.  Likewise, 
the  book  by  N.  Mann,  R.  E.  Schafer,  and  N.  D.  Singpurwalla  [14]'should  be 
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noted.  In  particular  Chapter  10  is  relevant  to  this  discussion  and  a 
commonly  employed  method,  called  the  AO  method  is  described  therein.  Also 
Bayesian  methods-  such  as  these  proposed  by  0.  Mastran  [16]  and  D.  Mastran 
and  N.  D.  Singpurwalla  [17],  have  been  omitted,  since  these  are  obtained 
using  a  different  set  of  principles  than  the  methods  which  are  compared 
in  this  paper. 

Given  this  large  number  of  available  techniques,  how  does  one  make  a 
selection?  To  answer  this  question,  in  the  course  of  the  preparation  of 
the  Handbook  for  the  Calculation  of  Lower  Statistical  Confidence  Bounds  on 
System  Reliability  [3],  an  extensive  investigation  of  various  procedures  was 
carried  out.  This  investigation  employed  both  simulation  methods  and 
numerical  calculations.  Among  the  requirements  sought  for  were  conservatism 
of  procedures.  However,  while  procedures  that  were  found  to  be  optimistic 
(non-conservative)  were  regarded  as  not  satisfactory,  attention  was  paid  as  well 
to  accuracy,  namely,  that  the  true  confidence  coefficient  should  be  as  close 
to  (1-a),  the  nominal  confidence  coefficient,  as  possible.  Ease  of  computation 
was  also  considered.  Finally,  performance  of  the  statistical  procedures  for  high 
reliability  was  regarded  as  being  of  much  more  significance  than  performance  at 
low  reliabilities. 

This  investigation  established  among  other  things,  that  the  AO  method  and 
Easterling's  two  proposals  are  non-conservative.  CONLIM  satisfied  every  require¬ 
ment  with  the  exception  of  ease  of  computation. 

A  surprising  conclusion  of  this  investigation  was  that  the  Lindstrom- 
Madden  method  was  found  to  be  conservative,  but  not  excessively  conservative. 

In  short,  it  was  the  opinion  of  the  committee  entrusted  with  the  preparation 
of  this  handbook,  that  the  Linds trom-Madden  method  should  be  adopted  for  use 
and  be  the  method  reco* .\>\ided  in  the  handbook. 
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Since  the  investigation  undertaken  in  preparation  of  the  handbook  employed 
simulation  and  the  computation  of  a  large  number  of  numerical  examples, 
a  theoretical  explanation  for  the  impressive  performance  of  the  Lindstrom- 
Madden  method  is  needed. 

The  answer  to  this  is  provided  in  Harris  and  Soms  [8]  and  depends 
on  the  application  of  an  inequality  of  Sudakov  [21].  The  description  of 
these  results  follow. 

Let 


Ip(  «"»s)  = 


cr-10-t)s-'dt  . 


Then,  it  is  well  known  that 


=  Ip(n-y,y+l). 


(2.0) 


Let  u(n,y,a)  satisfy 


and  assume  that  ^  <  ...  <  Let 

„  k 

g(x)  =  n  (x./n  ), 
i=l  '  1 

and  let 


y,  =•  N,q0  =  N,il  -  £  -^)  , 


where  x  .  is  the  observed  value  of  X..  Then  Sudakov  showed  that 
01  1 


(21) 


(22) 


u(Nryr^)  •  b  :  u(N-j  ,[y^],a). 


(23) 
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where  b  is  the  1-a  Buehler  optimal  lower  confidence  limit  for  g(X). 

How  u(N-|,y^,a)  is  the  Lindstrom-Madden  so^tion.  Thus,  it  follows  that  if 
y  is  an  integer,  the  Lindstrom-Madden  solution  is  optimal. 

In  Harris  and  Soms,  a  generalization  of  the  Sudakov  inequality  was 
employed  to  show  that  (23)  holds  when  y-j  is  computed  for  any  of  a  large 
class  of  ordering  functions  in  addition  to  the  maximum  likelihood  estimator. 
This  class  includes 

k  v 

9<x)  =  . 

i=l  "i 

g(X)  =  n(X.  +  a.),  a.  >  0, 

and  n^c^  a  a^+-j  n^,  and  the  choice  (7)  employed  by  Johns.  In  addition, 
an  improvement  on  the  upper  bound  in  (23)  was  obtained.  In  short,  if 

“ft 

y.  =  max  {y1 :g(y)  s  g(yQ),  y.  =  N.-x.,  yQ.  =  (24) 

and  ^  =  (0,...,0,  yi,...,yj<),  y*  =  y]f  then 

u(N1,y1,a)  <  b  s  mjn  u(N.[y*],a),  (25) 

holds  for  a  class  of  ordering  functions,  which  includes  many  commonly  in 
use.  Forthe  relevant  details,  see  Harris  and  Soms.  The  lefthand  side  of 
(25)  may  be  regarded  as  a  generalization  of  the  Linstrom-Madden  method. 
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4.  LOWER  CONFIDENCE  UNITS  FOR  THE  RELIABILITY  OF  PARALLEL  SYSTEMS 

To  some  extent,  there  is  a  duality  between  series  and  parallel  systems. 

For  a  parallel  system, 

k  k 

l-h(fs)  =  n  q,  =  H  (l-p)  .  (26) 

1=1  1  1=1 

Thus,  interchanging  reliability  and  unreliability,  success  and  failure, 
p.|  and  l-p.j=q.j  converts  any  probability  statement  about  a  series  system 
into  an  "equivalent"  statement  about  a  parallel  system.  Unfortunately,  this 
duality  will  not  extend  as  readily  to  the  statistical  inference  aspects. 

The  reasons  are  that  the  above  duality  will  result  In  conservative  confidence 
bounds  being  changed  Into  non-conservative  bounds.  Also  high  reliability 
becomes  high  unreliability,  an  area  of  little  interest  to  practitioners. 

Fruther,  the  Poisson  approximation  techniques  employed  in  the  study  of  one 
type  of  system  will  not  carry  over  to  the  other,  since  small  failure  probabilities 
become  small  success  probabilities*  again  a  situation  of  virtually  no  interest. 

Nevertheless,  some  parts  of  the  previous  discussion  for  series  systems  does 
carry  over  to  parallel  systems. 

For  this  reason,  it  is  convenient  to  replace  the  problem  of  finding 
a  lower  confidence  limit  for  the  reliability  by  the  problem  of  finding  an 
upper  confidence  level  for  the  unreliability.  Then,  to  make  the  analogy 
with  series  systems  clearer,  we  will  denote  the  unreliability  by  R(j5)  and 
the  ordering  function  based  on  failures  by  g(X),  where  51  denote  failures, 
that  is 


1-h(p)  *  fi(p),  Ni-Xi  •  ^  , 


and  g(X)  will  often  be  an  estimator  of  the  unreliability. 


Buehler's  [2]  method  of  computing  separate  l-(l-ct)^  confidence 

bounds  carries  over,  however,  the  Poisson  approximations  that  he  uses  to  get 

specific  numerical  values  are  valid  only  for  parallel  systems. 

Madansky's  [13]  method  using  the  Wilk's  likelihood  ratio  statistic 

is  equally  valid  for  parallel  systems,  since  in  employing  a  continous 

approximation,  namely  the  chi-square  distribution,  the  transference  from 

conservatism  to  optimism  does  not  take  place.  Thus,  all  comments  about  the 

use  of  the  technique  for  series  systems  apply  essentially  unchanged  for 

parallel  systems.  Similarly,  the  comments  about  use  of  the  asymptotic  theory 

for  the  maximum  likelihood  estimator  remain  unchanged. 

The  observations  of  Epstein  [5]  that  the  ordering  functions 

(X^+l  )(5?2+l  )/N^N2  Is  preferable  to  X^/N^  is  far  more  relevant  to 

parallel  systems  than  to  series  systems.  To  see  this,  note  that  the  maximum 

k  k  k 

likelihood  estimator  of  II  q .  is  n  X./  IT  N.,  where  X.  is  the  number 

1=1  J  1*1  1  1*1  1  1 

of  observed  failures  of  the  itn  component.  In  the  case  of  high  reliability,  X 

will  tend  to  be  small  and  one  would  like  to  believe  that  it  will  frequently  be 

k 

zero.  The  difficulty  with  an  ordering  function  such  as  n  (X./N.)  is  that 

i=l  1  1 

for  k  *  2,  the  sample  outcomes  Xj  =  0,  X2  =  0  is  not  distinguished  from 
X1  *  0,  Xg  “  100,  when  =  100.  More  precisely,  the  partition  induced 

by  g(X)  Is  then  very  coarse  when  at  least  one  X.  is  zero.  Consequently,  the 
use  of  a  fine;'  partition  for  the  high  reliability  situation  may  produce  less 
conservatism  and  greater  accuracy.  Presumably,  sim’lar  considerations 
motivated  the  choice  of  p^  for  the  C0NLIM  met'now,  which  in  this  case  gives 

k 

g(X)  -  if  (x,+l)/(N.+2)  .  (27) 

i-1  1 

A  somewhat  different  technique  for  obtaining  an  upper  confidence  limit  on 
h(p)  is  given  in  Karris  |7],  whore  the  exponential  family  theory  is  u»*vl  to 
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obtain  the  uniformly  most  accurate  unbiased  upper  confidence  limit.  However, 
this  technique  does  not  have  a  simple  description  in  terms  of  an  ordering 
function. 

The  specific  question  of  Buehler  optimality  for  parallel  systems  was  con¬ 
sidered  in  Harris  and  Soms  [9].  There  the  following  results  were  obtained. 

Let 


k  . 

g(X)  =  n  (X.+d),  1  <  d  <  1.5.  (28) 

i=l  1 


Then  replacing  the  binomial  distribution  by  the  Poisson  approximation,  for 
z  any  failure  vector  with  x^  *  5  for  some  1  s  i  s  k  and  x^  =  0 
otherwise,  and  letting 


Az  =  {V  9<xo}  5 

where 


(29) 


P*(g(K)  s  g(xQ)} 

is  a  Schur-concave  function  of  -  Jin  X^,  i  *  1,2,...,k,  where  X  is  the  parameter 

vector  for  the  Poisscn  approximation  obtained  by  letting  X^  *  ,  i  * 

l,2,...,k).  The  reader  Is  referred  to  A.  W.  Marshall  and  I.  Olkin  [15]  for 

details  on  the  properties  of  Schur-concave  functions.  This  enables  one  to 

conclude  that  for  X  e  A  the  Buehler  optimal  upper  confidence  limit  for 
k  o  z 

n  X,  is  given  by  the  solution  of 
1=1  1 

P**(g(X)  s  g(x0))  *  a  ,  (30) 

whore  \*  3  (a,...,a),  namely  has  all  components  Identical.  This  Schur- 
cnncavi f.y  .irguronl  nay  be  extended  to  other  ordering  functions  than  (2S'.  In 
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particular,  the  choice  used  by  Buehler  [2]  also  satisfies  the  necessary 
conditions. 

Unfortunately,  if  the  observed  vector  of  failures  lies  outside 
of  A~,  this  conclusion  does  not  hold  for  the  ordering  function  (23). 
Here,  upper  and  lower  bounds  for  the  Buehler  optimal  upper  confidence 
limit  have  been  constructed.  The  reader  is  referred  to  the  original 
paper  for  details.  [9]. 


19 


REFERENCES 


m 

[23 

[3] 

[4] 

[5] 

[6] 

[7] 

[8] 

[9] 

HO] 

HI] 

[12] 

[13] 

[14] 


R.  E.  Barlow  and  F.  Proschan,  Statistical  Theory  of  Reliability 
and  Life  Testing,  Probability  Models,  Holt,  Rinehart  and  Winston, 

Inc. ,  New  York.  1975. 

R.  J.  Buehler,  "Confidence  limits  for  the  product  of  two 
binomial  parameters”  J.  Amer.  Statist.  Assoc.  52  (1957),  482-493. 

Defense  Advanced  Research  Projects  Agency,  Handbook  for  the 
Calculation  of  Lowe'"  Statistical  Confidence  Bounds  in  System 
Reliability,  1980 

R.  G.  Easterling, "Approximate  confidence  limits  for  series 
reliability”  J.  Amer.  Statist.  Assoc.  67  (1972),  220-222. 

J.  E.  Epstein, "Upper  Confidence  limits  on  the  product  of 
two  binomial  providers'!  Cornell  University,  Master  of  Science 
Thesis,  1967 

|| 

R.  D.  Halbgewachs,  R.  C.  Mueller  and  F.  W.  Muller,  Classical  Upper 
Confidence  Limits  for  the  Failure  Probability  of  Systems”  Research 
Report  SLA-73-0563,  Saudie  Laboratories,  1973. 

B.  Harris,  Hypothesis  testing  and  confidence  intervals  for  products)f 
and  quotients  of  Poisson  parameters  with  applications  to  re1  iabil ity', 
J.  Amer.  Statist.,  66  (1971),  509-613. 

B.  Harris  and  A.  P.  Soms,  "Bounds  for  Optimal  Confidence  Limits  for 
Series  Systems,"  University  of  Wisconsin,  Statistics  Department 
Technical  Report  #611,  (1980). 

B.  Harris  and  A.  P.  Soms,  "Optimal  Upper  Confidence  Limits  for 
Products  of  Poisson  Parameters  with  Applications  to  the  Interval 
Estimation  of  the  Failure  Probability  of  Parallel  Systems,"  University 
of  Wisconsin,  Statistics  Department  Technical  Report  #613,  (1980). 

M.  V.  Johns,  Jr. , "confidence  Bounds  for  Highly  Reliable  Systems',' 
Stanford  University  Technical  Report,  (1976). 

D.  K.  Lloyd  and  M.  Lipow,  Reliability:  Management,  Methods  and 
Mathematics,  Prentice  Hall,  Englewood  Cliffs,  New  Jersey,  19-2. 

C.  Mack,  "Confidence  limits  for  the  product  of  binomial  parameters 
and  related  problems,"  New  J.  Statistics  and  Operations  Research, 

3  (1967),  3-13. 


A.  Madansky,  "Approximate  confidence  limits  for  the  reliability 
of  series  and  parallel  systems,"  Technometrics,  7,  (1965,  495-503. 


N.  R.  Mann,  R.  E.  Schafer,  and  N.  D 
Statistical  An ajy si s_  o_f.  Rd iab_i Ij t.y 
Sons,  New  \ c-'k ,  1974, 


Sinciourwalla, 
nd  Life  Oita, 


for 

John  Wiley  and 


20 


[15]  A.  W.  Marshall  and  I.  01  kin,  Inequalities:  Theory  of  Majorlzation 
and  Its  Applications,  Academic  Press,  Mew  York,  1979. 

[16]  D.  Mastran,  "A  Bayesian  approach  to  assessing  the  reliability  of  Air 
Force  re-entry  systems,"  Proc.  of  the  ASME  Reliability  and 
Maintainability  Symposium,  Gordon  and  Breach,  New  York,  1969. 

[17]  D.  Mastran  and  N.  D.  Singpurwalla,  "A  Bayesian  estimation  of  the 
reliability  of  coherent  structures,"  Operations  Research,  26, 
(1978),  663-672. 

[18]  R.  A.  Mirniy  and  A.  D.  Solov'yev,  "Estimation  of  the  Reliability  of 
a  System  from  the  Results  of  Tests  of  its  Components",  Kibernetiky 
na  Sluzhby  Kommunizmy,  2,  Energiya,  Moscow,  (1964). 

[19]  I.  V.  Pavlov,  "A  Confidence  Estimate  of  System  Reliability  from 
Component  Testing  Results",  Izvestiya  Akad.  Nauk.  Tech.  Kibernetiky, 
3,  52-61,  (1973). 

[20]  J.  R.  Rosenblatt,  "Confidence  limits  for  the  reliability  of  complex 
systems,"  in  Statistical  Theory  of  Reliability,  M.  Zelen,  ed., 
University  of  Wisconsin  Press,  Madison,  ( 1963). 

[21]  R.  S.  Sudakov,  "On  the  Question  of  Interval  Estimation  of  the  Index 
of  Reliability  of  a  Sequential  System,"  Engineering  Cybernetics,  12, 
55-63,  (1974). 

[22]  K.  A.  Weaver,  "The  determination  of  the  lower  confidence  limit  on  the 
reliability  of  serial  system,"  Proc.  of  the  NATO  Conference  on 
Reliability  Theory,  Turin  1969,  Gordon  and  Breach,  New  York, 
1971. 

[23]  A.  Winterbottom,  "Lowe1”  Limits  for  Series  System  Reliability  from 
Binomial  Data",  Journal  of  the  American  Statistical  Association, 

69,  782-8,  (19747: 


BH/APS/jvs 


SECURITY  CLASSIFICATION  Of  THIS  PAGE  t»**n  tloio  V.ninod) 


REPORT  DOCUMENTATION  PACE 

RK AD  INSTRUCTIONS 

IIEKOKK  COMI'1.1'1  INC.  I'OKM 

1.  HtrOHT  HUHULH  1.  GOVT  ACCESSION  NO. 

#2312 

i.  RECIPIENT'S  CATALOG  NUHIItN 

«.  TITLE  (ond  Submit) 

Recent  Advances  in  Statistical  Methods  for  System 
Reliability  Using  Bernoulli  Sampling. of  Components 

•  L 

>.  TYPE  OF  REPORT  A  PERIOD  COVCRCO 

Summary  Report  -  no  specific 
reporting  period 

t.  PERFORMING  ORG.  REPORT  NUMBER 

7.  AUTHOR/*/ 

Bernard  Harris  and  Andrew  P.  Soms 

•.  CONTRACT  OR  GRANT  NUMBER/*/ 

N00014-79-C-0321 
DAAG29-80-C-00  41 

t.  performing  organization  name  ANO  ADDRESS 

Mathematics  Research  Center,  University  of 

610  Walnut  Street  Wisconsin 

Madison,  Wisconsin  53706 

10.  PROGRAM  ELEMENT,  PROJECT,  TASK 
AREA  A  WORK  UNIT  NUMBERS 

Work  Unit  Number  4  - 
Statistics  and  Probability 

II.  CONTROLLING  OFFICE  NAME  ANO  AOORESS 

(see  Item  18  below) 

IZ.  report  oatk 

December  1981 

1).  NUMBER  OF  PACES 

20 

14.  MONITORING  VGENCY  NAME  4  AOORESS///  dliltfont  from  Controlling  Ofltct) 

IS.  SECURITY  CLASS,  (ol  UU •  ropon) 

UNCLASSIFIED 

it«.  DECLASSI  F|  CATION/ DOWNGRADING 

schedule 

IE.  DISTRIBUTION  STATEMENT  (ol  Olio  Report) 

Approved  for  public  release;  distribution  unlimited. 

IT.  DISTRIBUTION  STATEMENT  ( ol  II it  obtlroc!  talttod  In  Blotk  30,  II  dlllortnl  tram  Kopott) 

l».  SUPPLEMENTARY  NOTES 

U.  S.  Army  Research  Office  •  Office  of  Naval  Research 

P.  0.  Box  12211  Department  of  the  Navy 

Research  Triangle  Park  Arlington,  VA  22217 

North  Carolina  27709 

IS.  KEY  BOROS  (Coni  Inu*  on  tor  otto  ago  it  nttottoiy  ond  Idtnllly  by  blotk  numbot) 

reliability,  systems  reliability,  confidence  bounds,  parallel  systems,  series 
systems,  Schur  concavity,  Buehler  optimality 

20.  ABSTRACT  ( Conilnuo  on  tororto  old*  II  notonory  ond  Idontlly  by  blotk  ntmborj 

The  pape,  provides  a  survey  of  results  in  statistical  inference  in  systems  reli¬ 
ability  using  Bernoulli  sampling  of  individual  components.  Particular  attention  is 
given. to  the  notion  of  Buehler  optimality  and  its  implementation  in  such  problems. 
Recent  results  of  the  authors  on  Buehler  optimal  confidence  bounds  on  the  reliabil¬ 
ity  of  series  and  parallel  systems  are  discussed.  For  series  systems,  these  results 
employ  a  generalization  of  an  inequality  of  Sudakov.  For  parallel  systems,  Buehler 
optimal  bounds  are  obtained  for  small  numbers  of  failures  using  the  notion  of  Schur 
concavity,  estimates  of  the  optimal  bounds  are  obtained  in  those  cases  for  which 

DD  t  1473  coition  Oft  NOV  <«if  et  sotcrt  UNCLASSIFIED 

SECURITY  CLASSIFICATION  Of  THIS  PAOC  MunTm  t»iw*4 


